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(57) Abstract • y- 

A new data communication system is described which enables data transmissiotijover existing telephone lines at rates higher than 
possible with existing methods, including conventional modems. By using a novel asymmetric configuration of the two commune 
cndpoints. the currently-accepted maximum theoretical limits on the data rate arc no longer applicable^ One endpo.nt is connected directly 
to a digital telephone network, whereas the other endpoint uses a conventional telephone connection. This reduces the transmission problem 
to compensation for a single telephone line interface and a single analog local loop. Means of providing this compensation and the required 
clock synchronization were also created, enabling a practical implementation of the system. The new system can achieve rates up to 64 000 
bits-per-second and has broad utility in several active areas including wide-band audio transmission, video transmission, networkmg. 
facsimile transmission, and remote computer access. 
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HIGH SPEED COMMUNICATIONS SYSTEM . 
FOR ANALOG SUBSCRIBER CONNECTIONS 



BACKGROUND OF THE INVENTION 

The field of the present invention pertains generally to data communications equipment, and 
more particularly to a device for transmitting digital data over a telephone connection. 

Data commimication plays an important role in many aspects of today's society. Banking 
transactions, facsimiles, computer networks, remote database access, credit-card validation, and a 
plethora of other applications all rely on the ability to quickly move digital information from one 
point to another. The speed of this transmission directly impacts the quality of these services and, in 
many cases, applications are infeasible without a certain critical underlying capacity. 

At the lowest levels, most of this digital data traffic is carried over the telephone system. 
Computers, facsimile machines, and other devices frequently communicate with each other via 
regular telephone cormections or dedicated lines which share many of the same characteristics. In 
either case the data must first be converted into a form compatible with a telephone system designed 
primarily for voice transmission. At the receiving end the telephone signal must be converted back 
into a data stream. Both tasks are accomplished by modems. 

A modem performs two tasks corresponding to the needs above: modulation, which converts 
a data stream into an audio signal that can be carried by the telephone system, and demodulation, 
which takes the audio signal and reconstructs the data stream. A pair of modems, one at each end of a 
connection, allows bidirectional communication betweeii the two points. The constraints on the audio 
signal create the limitations on the speed at which data can be transferred using modems. These 
constraints include a limited bandwidth and degradation of data by noise and crosstalk. The 
telephone system typically can carry only signals that range in frequency between 300 Hz and 3,400 
Hz. Signals outside this range are sharply attenuated. This range was built into the design of the 
telephone system since it covers a significant portion of by the human voice spectrum. However, the 
bandwidth of a chaimel is one factor that determines the maximum attainable data rate. With all other 
factors constant, the data rate is directly proportional to the bandwidth. 
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Another factor is the distortion of the audio signal or any other signal that the 
communications endpoints cannot control. This includes electncal pickup of other signals being 
carried by the telephone system (crosstalk), electncal noise, and noise introduced by conversion of 
the signal from one form to another. The last type will be expanded upon in later discussion. 

For general utility, modems are designed to be operable over most telephone connections. 
Thus they must be designed for worst-case scenarios, which include bandwidth limitations and 
significant noise that cannot be removed. Even so. substantial progress has been made on modem ^ 
design in the past several years. Devices capable of operating at speeds up to 28.800 bits per second 
are now commonly available. See International Telecommunication Union. Telecommunication 
Standardization Sector (ITU-T). Recommendation V.34. Geneva. Switzerland (1994) which is hereby 
incorporated herein by reference. However, theoretical arguments based on the channel bandwidth 
and noise levels show that the maximum possible speed has nearly been obtained and further 

significant increases are highly unlikely with the given constraints. Hiis is discussed m C.E. 

Shannon. "A Mathematical theory of Communication." Bell System Technical Journal 27:379- 

423,623 -656 (1948) which is hereby incorporated herein by reference. 

Unfortunately, although speeds approaching 30.000 bits per second (or 3.600 bytes per 
second) make many data communications applications feasible, conventional modem transmission is 
stm not fast enough for all uses. At these speeds, transmission of text is fast, and low-quality audio, 
such as digitized speech, is acceptable. However, facsimile or still-image transmission is slow, while 
high-quality audio is limited and full-motion video has not been satisfactorily achieved. In short, 
what is needed is greater data transmission capability. Hus is a prerequisite for the new applications 
and is a necessity for maximizing the performance of many existing applications. 

Of course the telephone companies, cable-television providers, and others are not ignorant of 

these increasing data tr^mission needs. One approach to providing higher speed data connections 

to businesses and residences is to provide end-to-end digital connectivity, eliminating the need for 

additional modems. One offering of such a service is the Integrated Services Digital Network 

(ISDN) See: International Telecommunication Union, Telecommunication Standardization Sector 

(ITU-T) "Integrated Services Digital Net^vorks ISDNs). " Recommendation 1. 120, Geneva. 

Switzerland (1993). and John Landwehr, "TTte Golden Splice: Beginning a Global Digital Phone 

Nety^ork " Northwestern University (1992) each of which is incorporated herein by reference. ISDN 

replaces the existing analog local loop with a 160,000 bit/second digital connection. Since the bulk of 

A ;r,t^r office traffic is already carried digitally, this digital local loop can be used 
long-distancc and inier-oiu'- 
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for end-to-end digital voice, computer data or any other type of information transfer. However, to 
achieve these data transmission rates on the local loop, special equipment must be installed at both 
ends of the line. Indeed, the entire telephone network is currently undergoing a transformation from a 
voice transmission network to a general data transmission service, with voice just being one particular 
form of data. 

Once installed, each basic ISDN link will offer two data channels capable of 64,000 
bits/second a control channel with a capacity of 16,000 bits/second, reduced call connection time, 
and other benefits. At these rates, facsimile and still image transmission will be nearly instantaneous, 
high-quality audio will be feasible, and remote computer connections will benefit from a fivefold 
speed increase. Some progress toward full-motion video may also be achieved. 

The down side of ISDN is its availability or lack thereof To use ISDN, the user's central 
office must be upgraded to provide this service, the user must replace its on-premises equipment 
(such as telephones) with their digital equivalents, and each individual line interface at the central 
office must be modified to cany the digital data stream. This last step, the conversion to a digital hnk 
of the millions of analog connections between every telephone and the central office, is formidable. 
The magnitude of this task dictates that the deployment of ISDN will be slow and coverage will be 
sporadic for some time to come. Rural and sparsely populated areas may never enjoy these services. 
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Another existing infrastructure potentially capable of providing high-speed data 
communications services is the cable television system. Unlike the telephone system, which connects 
to users via low-bandwidth, twisted-pair winng, the cable system provides high-bandwidth 
connectivity to a large fraction of residences. Unused capacities on this wiring could provide data 
rates of tens, or even hundreds, of millions of bits per second. THis would be more than adequate for 
all of the services envisioned above includmg full-motion digital video. However, the cable system 
suffers from a severe problem - its network architecture. The telephone system provides point-to- 
point connectivity. That is, each user has full use of the entire capacity of that use^s connection-it is 
not shared with others and does not directly suffer due to usage by others. The cable system on the 
30 other hand, provides broadcast connections. The entire capacity is shared by all users since the same 
■ signals appear at each user's connection. ,Thus. although the total capacity is high, it is divided by the 
number of users requiring service. This architecture works well when all users require the same data, 
such as for cable's original design goal, television distribution, but it does not serve well a community 
of users with different data needs. In a metropolitan area the data capacity available to each user may 
35 be significantly less than via an ISDN or modem connection. 
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To provide high-speed, data connectivity to a large number of users, the cable system could 
be modified to isolate different segments of the user population effectively sharing the cable 
bandwidth over smaller populations. However, like ISDN, this will be a slow, costly process that will 
provide only partial service for many years to come. 

The methods used to design modems are based largely on models of the telephone system 
that have remained unchanged for several decades. That is, a modem is modeled as an analog 
channel with a finite bandwidth (400-3400 Hz) and an additive noise component on the order of 30 
dB below the signal level. However, a large portion of the telephone system now uses digital transfer 
of a sampled representation of the analog waveforms for inter-office communications. At each 
central office, the analog signal is converted to a 64,000 bit/second pulse code modulated (PCM) 
signal. The receiving office then reconstructs the analog signal before placing it on the subscriber's 
line. Although the noise introduced by this procedure is, to a first approximation, similar to that 
observed on an analog system, the source of the noise is quite different. See K. Pahlavan and J.L. 
Holsinger, "A Model for the Effects of PCM Compandors on the Performance of High Speed 
Modems. " Globecom '85. pages 758-762. (1985), which is incorporated herein by reference. Most of 
the observed noise on a telephone connection that uses digital switching is due to quantization by the 
analog-to-digital converters needed to convert the analog waveform into a digital representation. 

As noted above, most telephone connections are currently carried digitally between central 
offices at rates of 64,000 bits/second. Furthermore, ISDN services demonstrate that it is possible to 
transmit significantly more than these rates over the local loop. It has been suggested that it may be 
possible to design a transmission scheme that takes advantage of these factors. Kalet et al. postulate a 
system, shown in Figure 2, in which the transmitting end selects precise analog levels and timing such 
that the analog-to-digital conversion that occurs in the transmitter's central office might be achieved 
with no quantization error. I. Kalet, J.E. Mazo, and B.R. Saltzberg, "The Capacity of PCM Voiceband 
Channels. "IEEE International Conference on Communications '93, pages 507-51 1, Geneva. 
Switzerland (1993). which is incorporated herein by reference. By making use of the mathematical 
results of J.E. Mazo it is conjectured that it should be theoretically possible to reconstruct the digital 
samples using only the analog levels available at the receiver's end of the second local loop in the 
communications path. J.E. Mazo, "Faster-Than-Nyquist Signaling. " Bell System Technical Journal, 
54: 145 1-1462 (1975). incorporated herein by reference. The resulting system might then be able to 
attain data rates of 56,000 to 64,000 bits/second. The shortcoming of this method is that it is nothing 
more than a theoretical possibility that may or may not be realizable. Kalet et al. state that "This is a 
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hard practical problem and we can only conjecture if a reasonable solution would be possible. " Id. 
at page 510. 

An example of a conventional attempt to solve the foregoing problem is found in work by 
5 Ohta. described in US Patent Numbers 5,265.125 and 5,166.955. which are hereby incorporated by 
reference. Ohta disclosed an apparatus to reconstruct a PCM signal transmitted through a 
communications channel or reproduced firom a recording medium. These patents "exemplify some 
conventional techniques abundant in the literature to deal with the general problem of reconstructing 
a multi-valued signal that has passed through a distorting channel." See also, for example. Richard D. 
1 0 Gitlin. Jeremiah F. Hayes and Stephen B. Weinstein. "Data Communications Principles. " Plenum 
(1992), incorporated herein by reference. However, such conventional teachings do not consider the 
application of methods to handle the output from a nonlinear quantizer, nor do they deal with the 
specific problems of decoding digital data passed over a telephone local loop. Furthermore, the 
problem of reconstructing a sampling rate clock fi-om the PCM data is non-trivial when the PCM 
1 5 signal can take on more than two values. For example, in the patents by Ohta, a simple clock 
recovery scheme which relies on a binary input signal is employed. This type of clock recovery 
cannot be used with the multivalued codes used in a telephone system. Also, compensation for drift 
with time and changing line conditions requires use of an adaptive system which the prior art of PCM 
reconstruction does not include. 
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Thus, there is currently a critical disparity between the required or desired data 
communications capacity and that which is available. Existing modems do not provide adequate 
capacities, and new digital connectivity solutions are several years away from general availability. 
Refitting the existing infrastructure with ISDN capability is a sizable task and may take a decade 
before its use is widespread. A new method of data transmission could immensely benefit many 
current applications as well-as making several new services available which would otherwise have to 
wait until the infrastructure catches up with the requirements. 

Accordingly, there is a need for providing a new system of data transfer which provides the 
30 capability to receive data at high rates over existing telephone lines. 

There is also a need for an improved system of data transfer which can enable systems, 
equipment, and applications designed for a digital telephone system (such as ISDN) to be used with 

analog connections. 

35 
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There is also a need for an improved system of data transfer which is capable of taking 
advantage of the digital infrastructure of the telephone system without requiring costly replacement of 
all subscribers' lines. 

It also would be desirable to create a high speed communication system to provide a means 
to distribute high-quality digital audio, music, video, or other material to consumers. Such an 
improved system of data transfer would advantageously provide a means to distribute, on-demand, 
individually-tailored information, data, or other digital material to a large number of consumers. 

There is also a need for an improved high speed communications system to provide greater 
throughput for commercial applications such as facsimile, point-of-sale systems, remote inventory 
management, credit-card validation, wide-area computer networking, or the like. 

SUMMARY OF THE INVENTION i 
One aspect of the present invention comprises a system for transferring data over existing 
telephone connections at rates higher than known modems or conventional methods of data 
transmission. The present invention achieves a significant improvement over conventional methods 
by making use of two critical observations: 

1 . The underlying phone system is digital using PCM transmission. 

2. High data rates are required in one direction only, the source of which has direct 
digital access to the telephone system. 

An aspect of the present invention utilizes the foregoing observations to achieve higher data 
transmission rates than were previously attainable with conventional systems. The second 
observation above addresses the largest use of modems — to access and retrieve information from 
centralized servers. In addition, the present invention has been found particularly useful for 
applications that require higher data rates, such as database access and video or audio on demand. 
Such applications can be realized, utilizing the high data transmission rates that are attainable through 
the present invention. 

An important aspect of the invention is both simple and extremely powerful; that is, to allow i 
the data provider to connect directly to a digital telephone network while the consumer uses its | 
existing analog connections without change to the line. This configuration greatly changes the model r 
under which the consumer's data equipment must operate. Existing modems must deal with 
bandwidth limitations and multiple unidentified noise sources that corrupt a signal over the entire 
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transmission path. In contrast, an aspect of the present invention carries data, digitally over the bulk 
of the path, from the central office to the consumer's home or office, and converts it to analog form 
only for the last segment of that path. Advantageously, one of the primary sources of noise to 
existing modems, quantization noise during analog-to-digital conversion, is completely eliminated 
since such conversion is no longer required. Furthermore, quantization noise during digital-to-analog 
conversion, can be modeled as a deterministic phenomenon, and thus significantly reduced. 

By using the foregoing aspect of the invention, the data source, which has direct access to the 
digital network (for example, by ISDN), can transfer exact data to the central office serving the 
consumer of the data. All that is then required is a device at the consumer's end of the local loop that 
will compensate for distortion of the data signal due to the filtering performed at the central office's 
digital-to-analog converters and due to the transmission line. Both distortions can be dealt with 
adequately using existing digital signal processing hardware, as will be described herein. 

Note that although this method cannot be used for return data from the consumer to the 
server, existing modems can be used, giving an asymmetrical channel with a capacity of up to 64,000 
bits/second from server to consumer and 20,000 to 30,000 bits/second return. 

It will be appreciated that an aspect of the invention enables digital data of any type (audio, 
video, information, or the like) to be sent to individual users at speeds higher than can be obtained 
with conventional modems, or conventional methods of data transfer. Furthermore, unlike cable 
television distribution systems, this invention can service, at the full data rate, any number of users 
simultaneously requesting different data. 

Beyond providing greater speed of operation for existing applications, such as remote 
computer access, high-speed facsimile transmission, etc., certain aspects of the invention make 
several new applications possible. These include high-quality audio or music transmission, video-on- 
demand, still picture transmission, videophone, teleconferencing, or like applications in which high 
data transmission rates are essential. 

Another aspect of the present invention is to reconstruct a multivalued PCM data signal from 
an analog representation of that signal. This'is achieved using a new method which combines a novel 
clock synchronization technique with adaptive equalization. 
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In addition to the foregoing, other aspects and advantages of the present invention include: 
(1) the ability to effectively reconstruct the telephone system's digital pulse-code-modulated (PCM) 
data stream using only the analog signal at the subscriber end of the telephone line; (2) the ability to 
reconstruct the clock frequency and phase of the PCM data, using only the analog signal at the 
5 subscriber end of the telephone line; (3) the ability to increase the effective data rate between a 
central office and the subscriber end without adding additional equipment at the central office or 
otherwise modifying the telephone system; and (4) the ability to reconstruct said digital data after 
such data has been modified due to one or more of conversion to analog form, filtering, distortion, or 
corruption by the addition of noise. 

10 

BRIEF DESCRIPTION OF DRAWINGS 

These and other features, aspects and advantages of the present invention will become better 
understood with regard to the following descriptions, appended claims and accompanying drawings in 
15 which: 

Figure 1 is a block diagram showing a typical modem data connection; 

Figure 2 is a block diagram showing an example of a hypothetical symmetric digital system, 

20 Figure 3 is a block diagram showing a high speed distribution system in accordance with an 

aspect of the present invention; 

Figure 4 is a block diagram of a hardware implementation of an encoder 150 of Figure 3, in 
accordance with an aspect of the present invention; 

25 

Figure 5 is a block diagram showing the function of encoder 150 of Figure 3, in accordance 
with an aspect of the present invention; 

Figure 6 is a block diagram showing the function of a DC eliminator 184 of Figure 5, in 
30 accordance with an aspect of the present invention; 

Figure 7a is a graph of a data stream 100 as a function of time, such as would be applied to 
encoder 1 50 in accordance with an aspect of the present invention; 
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Figure 7b is a graph of a typical output from encoder 150 as a function of time, such as would 
be applied to a digital network connection 132 of Figure 3, in accordance with an aspect of the 
present invention; 

5 Figure 7c is a graph of a linear value 194 of Figure 6 as a function of time, this is the output 

signal from encoder 150 after conversion to linear form, in accordance with an aspect of the present 
invention; 

Figure 8 is a block diagram showing the function of existing digital line interfaces, for 
1 0 reference in understanding an aspect of the present invention; 

Figure 9 is a block diagram of a hardware implementation of a decoder 156 shown in Figure 
3, in accordance with an aspect of the present invention; 

1 5 Figure 10 is a block diagram showing the function of decoder 156 of Figure 3, in accordance 

with an aspect of the present invention; 

Figure 1 la is a graph of an analog signal 154 of Figure 10 as a function of time, in 
accordance with an aspect of the present invention; 

20 

Figure 1 lb is a graph of a compensated signal 2 74 of Figure 10 as a function of time, formed 
within decoder 156 in accordance with an aspect of the present invention; 

Figure 1 Ic is a graph of an estimated code stream'280 of Figure 10 as a function of time, 
25 formed within decoder 156 in accordance with an aspect of the present invention; 

Figure 1 Id is a graph of a data stream 126 of Figure 3 as a function of time, generated by 
decoder 156 in accordance with an aspect of the present invention; 

30 • Figure 1 le is a graph of an error signal 272 of Figure 10 as a function of time, generated by 

decoder 156 in accordance with an aspect of the present invention; 

Figure 12 is a block diagram showing an inverse filter 268 of Figure 10, in accordance with 
an aspect of the present invention; 

35 
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Figure 13 is a block diagram showing a feed-forward equalizer 300 of Figure 12, in 
accordance with an aspect of the present invention; 

Figure 14 is a.block diagram showing a filter tap 330 of Figure 13, in accordance with an 
aspect of the present invention; 

Figure 15 is a block diagram showing a clock estimator 264 of Figure 10, in accordance with 
an aspect of the present invention; 

Figure 16 is a block diagram showing the function of a clock synchronizer 260 of Figure 10, 
in accordance with an aspect of the present invention; 

Figure 17 is a block diagram showing an end-to-end asymmetric system with a reverse 
channel in accordance with an aspect of the present invention; 

Figure 18 is a block diagram showing an application of an aspect of the present invention 
with a database server; 

Figure 19 is a block diagram showing an aspect of the present invention in an application to a 
high speed facsimile system; 

Figure 20 is a block diagram showing a digital telephony relay in accordance with an aspect 
of the present invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 



Conventional Modem Data Connection 

A conventional moden) data connection is shown in Figure 1. Operation of such a system is 
well known and has been standardized by govemnient agencies such as the International 
Telecommunications Union. Depending on the types of a modem 104 and a modem 124, data may be 
applied at rates of up to 28,800 bits/second via the first user's data stream 100. Modem 104 converts 
data stream 100 into an analog signal, which is applied to a local loop 106, which in turn connects to a 
telephone switch 108. The analog signal is then carried through a telephone network 1 14 via a 
network connection 1 12 and eventually reaches, via a network connection 1 1 8, a telephone switch 
120 serving the second user. The signal is then passed, in analog form, via a local loop 122 to the 
second user's modem 124, which converts the signal to data stream 126, which will be a delayed 
version of data stream 100. In an exactly analogous way, a data stream 128 travels through the 
telephone network via modem 124, local loop 122, telephone switch 120, a network connection 116, 
telephone network 1 14, a network connection 1 1 0, -telephone switch 108, local loop 106, and modem 
104 to form a delayed version as a data stream 102. 

This system assumes that the telephone system reproduces the analog signal, applied at one 
user*s telephone coimection, at the other user's end with distortion and delay not greater than a set of 
standard values specified for the telephone system. One can show that, based only on these values, it 
is not possible to transmit data at rates greater than approximately 35,000 bits/second. This system 
ignores many details of the distortion, which may, in fact, be deterministic changes to the signal 
rather than unpredictable changes. One such deterministic change is quantization noise if telephone 
network 114 is implemented digitally. Existing modems cannot make use of knowledge of this 
significant noise source in eliminating distortion and are thus limited in their data rates. This is the 
key shortcoming of existing modem systems — low data rate and a theoretical limit on the maximum 
improvement that will ever be possible within the current framework of assumptions. 

In an attempt to overcome the foregoing shortcomings and disadvantages of a conventional 
modem data connection as shown in Figure 1 , an approach to increasing the rate of data transfer has 
resulted in a hypothetical symmetric digital communication system, Such a system is shown in 
combination with a digital telephone network in Figure 2. 
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This system, described by Kalet et al. in the previously cited reference, is similar to existing 
modems but with a new assumption; that the underlying infrastructure is a digital telephone network 
134. The operation is similar to that of the conventional modem system described above except that 
the signals are carried-in digital form within digital telephone network 134 and on a digital network 
connection 130, digital network connection 132, a digital network connection 136, and a digital 
network connection 138. Each user still requires a modem to transfer the information via local loop 
122 and local loop 106 to telephone switch 120 and telephone switch 108 respectively where 
conversion between analog and a standard digital format used by digital telephone network 134 is 
performed. 



Unlike conventional modems, no theoretical argument has yet been found which would limit 
the speed of such a system to less than that used internally within digital telephone network 134, 
typically 56,000 or 64,000 bits/second. Thus, it is hypothetically possible that such a system could 
obtain data rates up to 64,000 bits/second. However, such a system has never been reduced to 
1 5 practice nor is there any evidence that it would be possible to implement such a system. The authors 
of this system state that 'This is a hard practical problem and we can only conjecture if a reasonable 
solution would be possible, " 

The problem is that to make use of the knowledge that the underlying network is digital and a 
20 large part of the observed signal distortion is due to quantization noise, the transmitting modem must 
control, via only its analog output, the digital levels chosen by the network to encode the signal. 
Furthermore, the receiving modem must, via only its analog input, accurately infer those digital 
levels. Distortion due to analog/digital conversion occurs at both the transmitter and receiver's end 
yet only the combined distortion added to the desired signal is directly observable. Furthermore, 
25 additional distortion due to electrical noise and crosstalk also occurs on local loop 122 and local loop 
106. Separating out these distortion components from the desired signal and each other is a difficult, 
perhaps impossible, task. 



30 



One aspect of the present invention is a method by which the shortcomings of this approach 
are eliminated. It makes use of knowledge of the underlying digital network in a way that is 
realizable, providing higher attainable data rates than possible with any other known solution. 
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Sampling Rate Conversion 

As will be seen in subsequent discussion, a system for recovering PCM data from a distorted 
analog representation-requires a method of synchronizing the decoding clock with that used to convert 
5 the PCM data from a digital stream to analog values. Digital implementat.ons of this synchronization 
require that a digital data sequence be resampled. changing its rate from that used by an analog-to- 
digital converter to one whkh is closer to that used in conversion from PCM data. Previously knosvn 
techniques for achieving this are either strictly limited in their capabilities, or are computationally 
intensive. See, for example, R.E. Crochiere and L.R- Rabiner. "MuUitrate Digital Signal 
0 Processing, " Prentice-Hall, Englewood Cliffs, NJ, 1983. which is hereby incorporated herein by 

reference. Performing sampling rate conversion between two independent clocks whose relationship 
may change as a function of time further complicates the task. 

One aspect of the present invention is a method which can perform such conversion with a 
, 5 minimum of computational overhead. It accepts a continuously-variable input/output sampling rate 
ratio and performs the conversion with high accuracy. The techniques descnbed can obtain greater 
than 90dB anti-aliasing rejection and can be implemented in real-time on existing processors. 

Overall System 

20 ' Figure 3 shows an overview of the proposed system. The method of use of the system shown 

in Figure 3 is identical to that for current data communications circuits or modems. Data applied at 
data stream 100 will appear some time later at data stream 126. Data stream 100 to applied to 
encoder 150 whose fiinction is to convert the data stream into a format compatible with the telephone 
system The converted data is applied to digital telephone network 134 via digital network 
25 connection 132. Th. converted data emerges verbatim via digital network connection 138 at a client's 
telephone central office where a line interface 140 is located. At this point, if the client also had 
direct digital access to the digital connection to the chenfs line interface from digital network 
connection 138, the transmission would be complete. However, where the client, like the majonty of 
users, does not have direct digital access to the telephone network, this is not possible, and the 
30 following additional operations are required. 

Line interface 140 converts the digital data on digital network connection 138 into an analog 
fonn in a manner confonning to the standardized specifications of digital telephony. The analog form 
is carried on local loop 122 to the client's premises where a hybrid network 152 terminates the line 
35 and produces analog signal 154. Hybrid network 152 is a standard part which converts the two-wire 
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bi-directional signal to a pair of one-way signals. Decoder 156 uses analog signal 154 to estimate and 
compensate for the distortion introduced by the conversion to analog form performed by line interface 
140, resulting in an estimate of the digital data at digital network connection 138, which is assumed to 
be identical to the digital data that was applied at digital network connection 132. The transformation 
performed by encoder 150 is then inverted and decoder 156 outputs data stream 126, which is delayed 
estimate of the original data stream 100. 

Note that within Figure 3, all elements are well known and exist within current digital 
telephone systems except encoder 150 and decoder 156, which will be described in detail below. 
Also to be described below, is a method of initializing and adapting decoder 156 to the exact 
conditions encountered in normal operation. 

Physical Implementation of Encoder 

Figure 4 shows a block diagram of one possible realization of encoder 150 of Figure 3. Data 
stream 100 from Figure 3 is applied to the serial data input of a digital signal processor 160 such as an 
AT&T DSP32C. This processor uses a processor bus 162 to communicate with a read-only memory 
168, a random access memory 166, and an ISDN interface circuit 164 such as an Advanced Micro 
Devices Am79C30A. Read-only memory 168 contains a stored-program whose functional 
characteristics will be described in following sections. Random access memory 166 is used for 
program storage and parameters. ISDN interface circuit 164 also has an ISDN connection 170, which 
is connected to a network terminator 172, such as Northern Telecom NTI, and subsequently to digital 
network connection 132, which was also shown in Figure 3, 

To produce a fully-functional implementation, additional secondary elements such as 
decoders, oscillators, and glue logic would need to be added to the basic block diagram shown in 
Figure 4. Such additions are well known and will be evident to those skilled in the art. 

Subsequent discussion of encoder 150 will refer to functional rather than physical 
components, all of which can, for example, be implemented as programs or subroutines for digital 
signal processor 160 using well-known digital signal-processing techniques. 
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Encoder Operation 

Figure 5 shows a functional block diagram of encoder 150 of Figure 3. The channel from 
sender to client begins with arbitrary digital data provided as data stream 100. Encoder 150 converts 
this bustream into a sequence of eight-bu words sampled, preferably, at the telephone system's clock 
rate of 8 000 samples/second. This is achieved by a sequence of operations beginning with a senal- 
to-parallel converter 1 80, which groups together each eight bits read from data stream 100, outputtmg 
a stream of parallel eight-bit values as an 8-bit code stream 1 82. This mapping may preferably be 
performed such that the first of each eight bits read from data stream 100 is placed in the least- 
significant bit position of 8-bit code stream 182 with subsequent bits occupying consecutively more 
significant bit positions until the output word is complete, at which point the process repeats. DC 
eliminator 1 84 then inserts additional eight-bit values at regular intervals, preferably once per eight 
samples such that the analog value associated with the inserted value is the negative of the sum of all 
prior values on 8-bit code stream 1 82. This is necessary since telephone systems frequently attenuate 
or remove any DC bias on a signal. DC eliminator 1 84 is one example of a circuit means for reducmg 
DC components in the received analog signal. 

A detail of the functional elements of DC eliminator 184 of Figure 5 is shown in Figure 6. A 
code stream 186 output from a two-input selector 190 is also converted to linear value 194 by a ^- 
law-to-linear converter 192, which can be implemented as a 256-element lookup table usmg the 
standard ^-law-to-linear conversion table. Values of linear value 194 are accumulated and negated by 
a summer 196 and a unit delay 200 to form a DC offset 198 and a previous DC offset 202. which .s 
the corresponding unit-delayed value. DC offset 198 is applied to a linear-to-^-law converter 204, 
which can use the same lookup table as ^-law-to-lmear converter 192. but performing the inverse 
mapping Note that if DC offset 198 is greater than or less than the maximum or minimum value m 
the table, the respectively largest or smallest entiy will be used. A DC restoration code 206 is 
produced by linear-to-n -law converter 204 and applied as one input to two-input selector 190. Two- 
mput selector 190 operates by reading, preferably seven, sequential values from 8-bit code stream 182 
) and outputtmg these values as code stream 186, followed by reading and outputting a single value 
from DC restoration code 206. It then repeats this sequence of operations continually. 

Returning to Figure 5, code stream 186 is applied to the input lead of an ISDN converter 188, 
which provides the well-known conversion to an ISDN signal. The function of ISDN converter 188 is 
5 implemented directly by several existing integrated circuits, including an Advanced Mcro Devices 
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Am79C30. The output of ISDN converter 188 forms digital network connection 132, which is also 
the output of encoder 150 of Figure 3. 

For further understanding, some of the signals used by encoder 150 are illustrated in Figures 
7a through 7c. Figure 7a shows a sequence of samples of data stream 100, After processing by 
serial-to-parallel converter 180 and DC eliminator 184, code stream 186 is shown in Figure 7b. 
Within DC eliminator 184, the linear equivalent of code stream 186, namely linear value 194, is 
shovm in Figure 7c. 

Line Interface 

For reference during subsequent descriptions, Figure 8 shows a functional model of line 
interface 140 of Figure 3, such as would be found in a typical telephone system for use with an aspect 
of the present invention. Note that such interfaces are well known and are currently used in digital 
telephone switches. Digital telephone network 134 of Figure 3 passes an eight- bit-per-sample, n- 
law-encoded, digital data-stream via digital network connection 138 to a ^-law-to-linear converter 
210, shown in Figure 8. p-law-to-linear converter 210 implements the well-known ^i-law-to-linear 
conversion, converting each sample to a linear value 212. Linear value 212 is then converted to an 
analog signal 216 by a digital-to-analog converter 214 that is sampled using a telephone system clock 
236 in a well knov^m manner. Although not shown in Figure 3 for reasons of clarity, telephone system 
clock 236 is generated by digital telephone network 134. Analog signal 216 is then smoothed by a 
lowpass filter 218 to form a filtered signal 220. The main purpose of lowpass filter 218 is to provide 
a low-pass function with a cutoff frequency of approximately 3100 Hz. The International 
Telecommunications Union has standardized the specifications for digital-to-analog converter 214 
and lowpass filter 218 in International Telecommunication Union, Telecommunication 
Standardization Sector (ITU-T), "Transmission Performance Characteristics of Pulse Code 
Modulation, " Recommendation G. 712, Geneva, Switzerland, September 1992, which is hereby 
incorporated by reference. 

Filtered signal 220 is multiplexed onto local loop 122 by a four-to-two-wire converter 222. 
Local loop 122 is bi-directional; incoming signals on local loop 122 are applied to four-to-two-wire 
converter 222 and are output as an unfilte'red signal 234. Unfiltered signal 234 is applied to a 
bandpass filter 232, which has also been standardized by ITU-T in the above cited reference. The 
output from bandpass filter 232, a filtered signal 230, is converted to a linear value 226 by an analog 
to-digital converter 228. Linear value 226 is then converted to digital network connection 136 by a 



wo 98/37657 



17 



PCTAJS98/03093 



linear- to fi-law converter 224, which implements the standard linear-to-|i-law conversion. Note that 
in the system shown in Figure 3, digital network connection 136 is not used and has been omitted for 
clarity. 

Physical Implementation of Decoder 

Figure 9 shows a block diagram of one possible realization of decoder 156 of Figure 3. 
Analog signal 154 from Figure 3 is sampled by an analog-to-digital converter 240, which exists as an 
integrated circuit, such as a Crystal Semiconductor CS5016. This uses a clock signal 244, preferably 
at 16 kHz, generated by an oscillator 242, to form a digital input signal 246, which is connected to a 
bank of digital signal processors 248, such as AT&T DSP32C*s, via one of their serial digital input 
leads. The processors are also connected to each other and to a random access memory 254 and a 
read-only memory 252 via a processor bus 250. Read-only memory 252 contains a stored-program 
whose functional characteristics will be described in following sections. Bank of digital signal 
processors 248 produces data stream 126, which is the final output of decoder 156 of Figure 3. 

To produce a fully-functional implementation, additional secondary elements such as 
decoders, oscillators, and glue logic would need to be added to the basic block diagram shown in 
Figure 9. Such additions are well known and will be evident to those skilled in the art. 

Subsequent discussion of decoder 156 will refer to functional rather than physical 
components, all of which can, for example, be implemented as programs or subroutines for the bank 
of digital signal processors 248 using well-known digital signal-processing techniques. 

Decoder Operation 

Figure 10 shows the functional structure of decoder 156 of Figure 3. Analog signal 154 from 
Figure 3 provides the input data to decoder 156. Analog signal 154 is fed to analog- to-digital 
converter 240 and converted to digital input signal 246, preferably sampled at 16,000 samples per 
second with 16 bits per sample precision. Analog-to-digital converter 240 exists as an integrated 
circuit, such as a Crystal Semiconductor C§5016. Digital input signal 246 is then processed by clock 
synchronizer 260 which interpolates and re-samples digital input signal 246 at intervals separated by 
a period estimate 262 to produce a synchronized signal 266. The operation of clock synchronizer 260 
will be detailed in following sections. Synchronized signal 266 is filtered by inverse filter 268, which 
will be described below, to reconstruct compensated signal 274. The purpose of inverse filter 268 is 
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to invert the transformation performed by line interface 140 of Figure 3 of which the pnmary 
component is lowpass filter 218 of Figure 8. Returning to Figure 10, inVerse filter 268 also outputs a 
delay error estimate 270 giving the timing error inherent in synchronized signal 266, which will be 
used by clock estimator 264, described below, to compute the period estimate 262 used by clock 
synchronizer 260. A decision means is then used to convert compensated signal 274 to a sequence of 
values from a discrete set. As an example, compensated signal 274 is converted to the nearest 
equivalent eight-bit ti-law word using a linear-to-ji-law converter 276 to give estimated code stream 
280. As described earlier, linear-to-^-law converter 276 may be implemented as a simple lookup 
table. 



During normal operation, a switch 292 gates estimated code stream 280 back as a desired 
output signal 286, which is converted back to a linear signal by a ^-law-to-linear converter 278 to 
form a linear value 284, n-law-to-linear converter 278 can be implemented as a simple lookup table 
as earlier described. During initialization, switch 292 will be set such that a predetermined training 
1 5 pattern 288 (not shown in Figure 3) is gated to desired output signal 286. This usage will be 
described below. 

Linear value 284 provides an estimate of the desired value of compensated signal 274. It is 
used to adaptively update inverse filter 268 such that compensated signal 274 is as close as possible to 

20 linear value 284. This adaptation is one example of a training means for adjusting the parameters of 
decoder 156, which will be further explained in the discussion of inverse filter 268 below. A 
subtracter 282 computes error signal 272 using compensated signal 274 and linear value 284. Error 
signal 272 is fed back to an input lead of inverse filter 268 in a feedback loop. Estimated code stream 
280 is also passed through a data extractor 290, which inverts the transformations performed by 

25 encoder 150 of Figure 3, to form the decoder's final output data stream 126. 

For purposes of understanding only, examples of some of the signals present in Figure 10 are 
plotted in Figures 1 la through l ie. Figure 1 1 a shows a typical input analog signal 154 to decoder 
156, as a function of time. During processing of this signal, decoder 156 forms compensated signal 
30 ^ 274, which is illustrated in Figure 1 lb. This signal is further processed to form estimated code stream 
280, shown in Figure 1 Ic. Finally, data extractor 290 of Figure 10 outputs data stream 126 shown in 
Figure lid. Error signal 272, formed for internal use within decoder 156, is shown in Figure 1 le. 

As mentioned above, analog-to-digital converter 240, subtracter 282, linear-to-p-laW 
35 converter 276, switch 292, and n-law-to-linear converter 278, all of Figure 10, are well known and 



wo 98/37657 



19 



PCT/US98/03093 



may be easily implemented by anyone skilled in the art. Following discussion will expand upon the 
implementation and operation of the remaining blocks; inverse filter 268, clock estimate or 264. clock 
synchronizer 260, and data extractor 290. 

Inverse Filter 

Figure 12 shows the internal details of inverse filter 268 of Figure 10. Inverse filter 268 is an 
example of an equalization means, which operates by performing Imear filtering operations on an 
input signal (synchronized signal 266). to produce an output signal (compensated signal 274). Inverse 
filter 268 also receives error signal 272 that indicates the mismatch between compensated signal 274 
and a desired value. It uses error signal 272 to update its filtering fiinction such that error signal 272 
in minimized. Such adaptive filter structures are well known; See for example Richard D. Gitlin, 
Jeremiah F. Hayes and Stephen B. Weinstein, "Data Communications Principles. " Tlenun (1992), 
incorporated herein by reference. However, for purposes of clarification we will describe herein a 
preferred implementation of inverse filter 268. In addition, inverse filter 268 forms delay error 
estimate 270, which is used by clock estimator 264 of Figure 10. 

Synchronized signal 266 is fed to feed-forward equalizer 300, which produces a partially- 
compensated signal 302 while using a correction signal 324 to perform adaptive updates. The 
operation of feed-fonvard equalizer 300 will be described below. Feed-forward equalizer 300 also 
outputs delay error estimate 270, which will be used by clock estimator 264 of Figure 10. Partially- 
compensated signal 302 is subsequently down-sampled by a factor of two by a down-sampler 304 to 
form a down-sampled signal 306. Down-sampler 304 operates by repeatedly reading two consecutive 
values from its input lead and placing the first of these on its output lead, discarding the second value. 
Down-sampled signal 306 is then applied to a subtracter 308 to form compensated signal 274. 
Compensated signal 274 is used by subsequent stages in Figure 10 and is also fed into a unit delay 
310 to form a delayed signal 312. Delayed signal 312 is then applied to the input lead of a feed-back 
equalizer 3 14 to form a distortion estimate 3116. Feed-back equalizer 314 is similar to feed-fonvard 
equalizer 300 and will be further described below. Distortion estimate 316 provides the second input 
to subtracter 308. Error signal 272 of Figure 10 is scaled by a constant factor at a gain element 3 18 of 
Figure 12 to form a coirection signal 320, which is applied as a second input signal to feed-back 
equalizer 314. Feed-back equalizer 314 uses correction signal 320 to perform adaptive updates. 

Error signal 272 is also up-sampled by a factor of two by an upsampler 326, which inserts a 
zero between each sample of error signal 272. Up-sampler 326 produces an up-sampled error signal 



wo 98/37657 



PCTAJS98/03093 



20 



328, which is subsequently scaled by a gain element 322 to provide correction signal 324. The use of 
correction signal 320 and correction signal 324 by feed-back equalizer 314 and feed-forward 
equalizer 300 respectively will be described below. The values of the parameters kf and kb of gain 
element 322 and gain element 318 respectively may. preferably, be in the range 10-2 to 10-15. 
Optimal values may easily be obtained by those skilled in the art without undue experimentation. 



10 



15 



20 



25 



Feed-forward and Feed-back Equalizers 

Figure 1 3 shows the internal structure of feed-for^^'ard equalizer 300 of Figure 12. Feed- 
forward equalizer 300 is composed of. preferably 8 ~ 128, identical copies of filter tap 330 connected 
in a chain. Any convenient number of taps can be implemented. The first filter tap 330 accepts 
synchronized signal 266 of Figure 12 and the last filter tap 330 outputs partially-compensated signal 
302 used in Figure 12. Each intermediate tap takes two input signals: a primary input 332 and a 
target input 336, to form two output signals: a primary output 334 and a target output 338. Each filter 
tap 330 also provides, as an output signal, a tap weight 340. which is used by a delay estimator 342 to 
compute delay error estimate 270. During operation, each filter tap 330 performs adaptive updates 
using, as an input, correction signal 324. 

Figure 14 shows the details of the function of each filter tap 330 of Figure 13. Each tap has 
■ two inputs, primary input 332 and target input 336. and provides two outputs, primary output 334 and 
target output 338. using standard signal processing blocks as shown in Figure 14. Primary input 332 
IS delayed by one sample by a unit delay 350 to form primary output 334. Meanwhile, primary mput 
332 is also multiplied by tap weight 340 using a multiplier 352 to give a weighted input 354. 
Weighted input 354 is added to target input 336 by a summer 356 to give target output 338. 



Adaptive update of tap weight 340 is performed by multiplying correction signal 324 by 
primary input 332 using a multiplier 366. A multiplier output value 364 provides a tap error estimate 
and is subtracted from a previous value 360 to form tap weight 340 using a subtracter 362. Previous 
value 360 is formed by a unit delay 358 using tap weight 340 as input. Each filter tap 330 also 

30 outputs tap weight 340. 

Returning to Figure 13, each filter tap 330 is fed to delay estimator 342. Delay estimator 342 
calculates delay error estimate 270 of the overall filter using the equation: 



35 
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/.5 where W; is an abbreviation for the i - th tap weight 340. In this way, delay estimator 342 provides 
an estimation means for determining a degree of error in period estimate 262 of Figure 10. 

The above description of feed-forward equalizer 300 of Figure 10 also applies to feed-back 
equalizer 314. The structure and operation of feed-back equalizer 314 are identical to that of feed- 
1 0 forward equalizer 300, with the exception that delay estimator 342 is not needed, so there is no 

equivalent to the delay error estimate 270 output. Also, feed-back equalizer 314 may use a different 
number of taps than feed-forward equalizer 300, preferably between one-quarter and one-half the 
number. The optimal number of taps to use for both feed-forward equaker 300 and feed-back 
equalizer 314 can be easily obtained by one skilled in the art without undue experimentation. 

15 

Clock Estimator 

Figure 15 shows the functional components of clock estimator 264 of Figure 10. Clock 
estimator 264 is one example of a circuit means that uses delay error estimate 270 to update period 

20 estimate 262. The signal input to clock estimator 264, delay error estimate 270, is scaled by a factor 
of k,, preferably in the range 10'* to 10*\ but dependent on the accuracy of the clock used for analog- 
to-digital converter 240, by a loop gain 370 to form phase error 374. Phase error 374 is then filtered 
with loop filter 376 to form period offset 378. Loop filter 376 is a low-pass filter whose design will 
be evident to those skilled in the design of phase-locked loops. Period offset 378 is added to nominal 

25 period 380 by summer 372 to create period estimate 262. Nominal period 380 is the a priori estimate 
of the ratio of half of the sampling rate of analog-to-digital converter 240 of Figure 10 to the 
frequency of telephone system clock 236 of Figure 8. Since telephone system clock 236 and the clock 
used by analog-to-digital converter 240 are not derived ft*om a common source, the exact ratio will 
differ very slightly fi-om 1.0 for the preferred choices of parameters. During operation, period 

30 estimate 262 will refine and track this ratio using estimates of the current error provided by inverse 
filter 268 of Figure 10. 
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Clock Synchronizer 

A functional block diagram of clock synchronizer 260 of Figure 10 is shown in 
Figure 16. The function of clock synchronizer 260 is to interpolate and resample its input 
signal (digital input signal 246) at intervals separated by period estimate 262. For example, if 
period estimate 262 had a value of 2.0, every second sample read from digital input signal 
246 would be output as synchronized signal 266. If period estimate 262 is not an integer, 
then clock synchronizer 260 will be required to appropriately interpolate between input 
samples to form the output samples. 

Clock synchronizer 260 performs one cycle of operation for each output sample 
required. Each cycle begins with an accumulator 424 reading the value of period estimate 
262 of Figure 10. Accumulator 424 forms a running sum of all inputs values read and outputs 
this sum as a real-valued sample index 426. This is scaled by a factor of M. preferably in the 
r^ge of 10-400. using a gain element 428 to form an upsampled sample index 430. The 
optimal value of A/" can easily be obtained by one skilled in the art without undue 
experimentation. An integer/fraction splitter 432 decomposes upsampled sample index 430 
into a sample index 422 and a fractional value 414. For example, if upsampled sample index 
430 had a value of 10.7. integer/fraction splitter 432 would set sample index 422 to 10.0 and 
fractional value 414 to 0.7. 



20 



One of the input signals applied to a sample selector 398 is formed by a string of 
operations starting with digital input signal 246. An upsampler 390 reads a value from digital 
input signal 246 and outputs IT samples consisting of the value read from digital input signal 
246 followed by zero values. The output stream from upsampler 390. an upsampled 
25 input signal 392. is applied to a low-pass filter 394. which has a passband cutoff frequency 
equivalent to 4 kHz. TT^e design of upsampler 390 and low-pass filter 394 are well known. 
See. for example. R.E. Crochiere and L.R. Rabiner, "Multirate Digital Signal Processing " 
Prentice-Hall. Englewood Chffs. NJ. 1983. which is hereby incorporated herein by reference. 
Low-pass filter 394 forms a filtered upsampled signal 396. which is used as an input to 
30 sample selector 398. 

Sample selector 398 is an example of a selection means, which reads a value from 
sample index 422 and interprets this as a sample number. It also maintains an internal 
count of how many samples it has read from its input lead connected to filtered upsampled 
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signal 396 since the system was initialized. It then reads additional samples from filtered 
upsampled signal 396 and forms output samples such that a sample 400 is a copy of sample s" 
read from filtered upsampled signal 396 and a sample 402 is a copy of sample s"+l. Sample 
400 is then scaled by fractional value 414 using a multiplier 404 to form a sample component 
5 408. Similarly, sample 402 is scaled by a fractional value 416 using a multiplier 406 to form 
a sample component 410. The magnitude of fractional value 416 is one minus the magnitude 
of fractional value 414, as computed using a subtracter 420, and a unit constant 418. Sample 
component 408 and sample component 410 are then added by a summer 412 to form 
synchronized signal 266, which is also the output of clock synchronizer 260 of Figure 10. 
10 The combination of multiplier 404, multiplier 406, and summer 412 is an example of an 
interpolation means for combining the samples selected by sample selector 398. 

Clock synchronizer 260 can also be used in other applications or as a standalone 
sampling-rate converter. In general, synchronized signal 266 is equivalent to digital input 
1 5 signal 246 but with a different sampling rate. The ratioof the two rates is specified by period 
estimate 262 which may change as a function of time. 

Note also that although the linear interpolation may appear to be a coarse 
approximation to the desired result, it is in fact quite accurate. By virtue of the oversampling 

20 performed by upsampler 390, filtered upsampled signal 396 has a frequency spectra that is 
near zero everywhere except for a narrow band around DC. The interpolation operation 
effectively creates images of this narrow passband in the frequency domain. The function of 
the linear interpolation is. then to filter out these images. Conventional implementations use a 
sharp, computationally-expensive, low-pass filter to achieve this. Although the linear 

25 interpolator is a very poor low-pass filter, it does have very deep spectral notches at exactly 
the frequencies where the undesired images will appear. It is the combination of the 
placement of these notches with the narrow alias images that makes this method very accurate 
while eliminating much of the computation from traditional techniques. 

30 Data Extractor 

The last stage of decoder 156 of Figure 3 is data extractor 290 of Figure 10. The 
function of data extractor 290 is to invert the transformations performed by encoder 150 of 
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Figure 3. These transformations consist of serial-to-parallel converter 180 and DC eliminator 
1 84 shown in Figure 5. 

To invert these transformations, data extractor 290 first removes the values inserted 
5 into the data stream by DC eliminator 1 84. This is done by simply discarding every eighth 
sample read from the input (assuming the DC elimination was done by DC eliminator 184 
using the preferred rate of once per eight samples). Once this is done, the stream of eight-bit 
values remaining can be converted back into a serial data stream 126 by outputting one bit of 
each word at a time, starting with the least-significant bit. Such techniques are well known 
10 by those skilled in the art. 



Initialization of System 



When a connection is first established between a server and a client, both encoder 
15 150 and decoder 156 of Figure 3 must commence in a state known to each other. Within 
encoder 150 the following initiation is performe'd: 



1. DC eliminator 184 of Figure 5 is initialized with two-input selector 190 of 
Figure 6 set such that its next output will be a copy of DC restoration code 

20 206. 

2. The output of unit delay 200 of Figure 6, previous DC offset 202, is 
initialized to 0.0. 

25 3. Code stream 1 86 of Figure 5 is temporarily disconnected from DC eliminator 

184. Instead a known sequence of 7V^, preferably 16-128, values is repeated 
N„ preferably 100-5000, times. The optimal values to use for N^, and N^, can 
be easily obtained by one skilled in the art without undue experimentation. 

30 The choice of A^^, above is tied to the design of decoder 1 56. A^^ is preferably one- 

half of the number of taps in feed-forward equalizer 300 of Figure 12. Without loss of 
generality, one possible choice of the sequence of code values repeatedly transmitted by 
encoder 150 is shown in Table 1. An identical sequence is also used by encoder 150, applied 
as training pattern 288 in Figure 10. 
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Table 1: Typical Training Pattern 



14 


182 


29 


140 


20 


138 


153 


16 


132 


205 


157 


170 


4 


162 


129 


12 


8 - 


144 


54 


134 


10 


128 


6 


34 


136 


42 


77 


25 


148 


1 


142 


0 



Once the N^, repetitions of the sequence have been output, code stream 186 will be 
reconnected to DC eliminator 184 and subsequent output from decoder 156 will be 
reconnected to DC eliminator 184 and subsequent output from decoder 156 will correspond to 
1 0 the input applied as data stream 100 of Figure 3. 

Within decoder 156 of Figure 3, the following initiation is performed before the first 
sample is read from analog signal 154: 

1 • Switch 292 of Figure 10 is set to gate" training pattern 288 to desired output 
signal 286. 

2. Data extractor 290 of Figure 10 is set so the next input value, estimated 
code stream 280, will be considered a DC equalization value and thus be discarded. 

20 

3. Unit delay 310 of Figure 12 is initialized to output zero as delayed signal 
312. 

4. Upsampler 326 of Figure 12 is initialized such that its next output, up- 
25 sampled error signal 328, will be a copy of error signal 272. 

5. Downsampler 304 of Figure 12 is initialized such that its next input value, 
partially-compensated signal 302, will be copied out as downsampled signal 
306. 



30 



6. Within feed-back equalizer 3 14 and feed-forward equalizer 300 of Figure 12, 
each unit delay 350 of Figure 14 is initialized to have a zero output. 
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7. Within feed-back equalizer 3 14 of Figure 12, each unit delay 358 of Figure 
14 is initialized to zero. 

8. Within feed-forward equalizer 300, each unit delay 358 of Figure 14 is 
5 initialized to zero. 

9. Accumulator 424 of Figure 16 is initialized to output a value of zero as real- 
valued sample index 426. 

Q 10. Low-pass filter 394 is initialized with an all-zero internal state. 

1 1 . Upsampler 390 is initialized such that its next output, upsampled input signal 
392, will be the value of digital input signal 246. 

1 5 Decoder 156 then operates as described e^lier until N, - A^, values have been formed 

at estimated code stream 280 of Figure 10. At this point, switch 292 is moved to gate 
estimated code stream 280 to desired output signal 286. From this point on, data stream 126 
should correspond to data read from data stream 128 as shown in Figure 3. 

20 It must also be ensured that encoder 150 and decoder 156 enter and leave 

initialization mode such that the values on data stream 100 and data stream 126 of Figure 3 
are in exact correspondence. One example of a method to achieve this synchronization is to 
violate the DC restoration performed by DC eliminator 184. To signal the beginning of 
training, code stream 186 is set to the maximum legal code value for longer than the normal 

25 DC restoration period, for example for 16 samples. This is followed by setting code stream 
1 86 to the minimum legal code value for the same number of samples. The training pattern 
then follows this synchronization pattern. Similarly, the end of training can be signaled by 
reversing the order of the above synchronization pattern — repeating the minimum value 
followed by the maximum value. These synchronization patterns can then be detected by 
30 decoder 156 and used to contt-ol switch 292. 

Other techniques for such synchronization are well known and are used in existing 
modems. See, for example, ITU-T, V.34, previously cited. 



35 



Alternate Delay Estimator 
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In previous discussion, delay estimator 342 was formed by examination of the filter 
tap weights within feed-forward equalizer 300. Other delay estimation means are also 
possible. • For example, error signal 272 and compensated signal 274 of Figure 10 can be 
used to form delay error estimate 270 as follows: 

^ 5 

A = -^ 
dt 

where A is delay error estimate 270, v is compensated signal 274, e is error signal 272, and k 
10 is a parameter which can be easily obtained by those skilled in the art without undue 

experimentation. The value of k will depend upon the relative contributions of signal noise 
and clock jitter observed. Any other methods of implementing a delay estimation means to 
form delay error estimate 270 may also be used in the present invention. 

1 5 Alternate Decoder InitializatioD Method 

As described above, the parameters of decoder 156 may be established using fixed 
initialization values followed by a training period during which a known data sequence is 
transmitted. The previously described method uses the training sequence to perform 
sequential updates of the parameters of inverse filter 268 and clock estimator 264 on a 
20 sample-by-sample basis. 

It is also possible to perform a single block update of all parameters. During the 
transmission of the training sequence, decoder 156 merely stores the values that appear as 
digital input signal 246. Once the entire training sequence has been transmitted, decoder 156 
25 can perform an zinalysis of the acquired values and calculate values for its internal 
parameters. 

The calculations needed to perform the parameter estimation are as follows: 

30 1. Calculate the fimdamental digital period, T^, of the acquired signal using a rate 

estimation means. This can be done using any of a variety of well-known signal 
processing techniques, such as an autocorrelation analysis. It is known in advance 

that r„ is approximately twice A'^^ the length of the training sequence, assuming the 
use of the preferred sampling rate for analog-to-digital converter 240, The only 
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source of difference will be due to differences between the sampling rate of telephone 
system clock 236 and half the samphng rate of analog-to-dig.tal converter 240. 

2 lnitialize-noniinalpenod380ofFigurel5as f. 

2 N/ 



10 



15 



25 



3 Resample digital input signal 246 by pass.ng it through clock synchronizer 260 
with delay error estimate 270 set to zero, to fom. synchronized signal 266. 

4 Form a matrix Y with 2 -N. columns and H rows. The elements of r are the 
values of synchronized signal 266 as computed above, ^se are stored m the matnx 
by ftllmg the first row with sequential samples of synchronized signal 266. then the 
second row, and so on. 

5. compute *e m«n of each colunm of U .o fc„n ,. a 2 . N. eUmen, vec»„. 



-.Hn„tt of enerev o' . of ihe noise component of the input signal 

6. Compute an estimate oi energy, ^ ,^ 

20 using: ^ ill^ 

. N, /.I !•» 



where - ,j 



Y • is the element in column I, row j of Y. 



, Contputethe eictnent vector, c.b, passing th. «,ning se,uenee values, such 
as those shown in Tah.e 1 , through a convettet such as .-..w-to-linea, convener 278. 

A with N.+ N. columns and rows as follows: 
8. Form a matnx. A, wim /v^ 'b 



30 
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10 



where is the number of filter taps in feed-fonvard equalizer 300 of Figure 12 and 
Nf^ is the number of filter taps in feed-back equalizer 314. For example, \{N, = Nj- 
= 4, and A/^ = 2, then: 



V, r3 r, C3 

1^3 ^ ^^5 ^^6 ^3 
1^5 U ''7 ^2 



15 



20 



9. Find the value of a AJ^+ A^^ element vector, x, which minimizes e^ in the 
following equation: 



This can be solved using well-known techniques from linear algebra, calculus 
and iterative methods, which will be obvious to those skilled in the art. 



25 



10. Initialize previous value 360 of Figure 14 for each tap of feed-forward equalizer 
300 withxy... xNf respectively. 



1 1 . Initialize previous value 360 for each tap of feed-back equalizer 314 with xNf + 
1 N 

... xNf+ b respectively. 



30 



12. Once these parameters have been computed, normal operation can 
commence. Note that the parameters will subsequently change due to adaptive 
updates based on error signal 272, as previously discussed. 
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The above sequence should be viewed as an example of another method of doing 
initiation of decoder 156 using a training sequence. Other methods and numerous variants are 
also possible. For example, the received training sequence may be truncated at each end to 
remove effects of theiransient in switching between normal and training modes; the exact 
5 transition levels in linear-to-^i-law converter 276 and n-law- to-linear converter 278 may be 
adjusted using the training information, modified equations for each previous value 360 may 
be used, etc. 



Preferred Alternate Training Procedure 

^ 0 The following is a description of the preferred steps in training the encoder 1 50 and the 

decoder 156, shown in Figure 3: 

1. The encoder 150 sends a repeating pattern to the digital telephone network. This pattern 
consist of ^.repetitions of a sequence of PCM codewords to give a total ofMx N 
codewords. The term "PCM codewords" as used herein refers the set of codewords that is 

-] 5 utilized by the digital telephone network 134. The PCM codewords are each chosen 

randomly from two values which are the negative of each other. For example, the PCM 
codewords 0x14 and 0x94 correspond to the negative of each other under the telephone 
network's ^i-law companding rule. The random selection is also constrained such that each 
of the two PCM codewords is used exactly N/1 times. This guarantees that the training 

20 sequence will not have any DC component. 

2. The decoder 156 receives the analog signal 154, which is the analog equivalent of the 
PCM codeword pattern, and stores it using prior knowledge of M and M The analog 
signal 154 is sampled and stored at a nominal rate of 16000 samples/second. 

25 

3. The stored sequence is analyzed to find its repetition rate using standard signal processing 
techniques. Although the period associated with the repetition rate should be M8000 
seconds, there may be a slight discrepancy due to the difference in the exact values of the 
decoder's clock and the clock used by the telephone network 134. This discrepancy in 

3Q ■ repetition rate may then be used to adjust the decoder's clock and resample the stored 

signal using the corrected clock. This process can be repeated multiple times until the 
measured period exactly matches that expected. 

4 The noise level is preferably measured by looking at the variance among the M repetitions 
3g jj^g test pattern. Each repetition should be identical and it is only the noise that causes 
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these variations. Some of the repetitions, including the first or last ones, may be ignored if 
they are significantly different from the mean. H^is may eliminate or decrease end effects 

and intermittent noise bursts or crosstalk. 

5. The average signal level of the considered repetitions ,s then detennined givmg an average 
received sequence with length 2N. The length 2A^arises from sampling the incoming 
analog signal 154 at 16000 samples/second. 

6. An optimal equalizer is designed using the known transmitted sequence, the average 
received signal level and the noise estimate. The equalizer with the minimum mean- 
squared error is found by solving a set of linear equations using well-known methods. In 
particular, a combination of a fractionally-spaced equalizer with 90 taps operating at 
16,000 samples/second followed by a 20-tap decision-feedback equalizer operating at 
8000 samples/second may be used. 

7. The mean-squared eiror estimate and the equalizer settings may be transmitted back to the 
encoder 150 when a reverse chamiel is utilized, as described below. The encoder 150 then 
uses these values to choose a codeword set and encoding method that maximizes the 
throughput of the communication link. 

After training is completed, the encoder 150 begins sending data via the link. Hie decoder 156 
uses the computed clock adjustment and equalizer setting to compensate the received signal and then 
makes decisions as to which PCM codeword was sent by the encoder 150. The choice is then further 
processed to convert the PCM codeword into a data sequence. In addition, the measured deviation 
between the compensated signal and the nearest actual PCM codeword is used as a continuous error 
measure. This error measure can be fed back to the equalizer and clock adjustment circuitry in the 
decoder 156 to allow continuous updates and prevent any drift. The error measures may also be used 
to detenmne if the quality of the line changes significantly in which case the encoder 150 is notified 
that a retrain should be initiated. 

Addition of a Reverse Channel Description 

Figure 17 shows an aspect of the present invention that combines the previously 
described communication system with a reverse channel. Data stream 100 is applied to 
encoder 150 as was described in reference to Figure 3. This in tum comiects to digital 
telephone network 134 via digital network connection 132. The data emerges verbatim from 
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the network at the cHent's central office via digital network connection 138. The digital 
information is converted to analog form by line interface 140 and placed in analog form on 
local loop 122. At the client's premises, hybrid network 152 forms incoming analog signal 
448 and an echo canceler 442 removes contributions to incoming analog signal 448 from an 
outgoing analog signal 444 to form analog signal 154. Analog signal 154 is then applied to 
decoder 156, which provides data stream 126: Data stream 128 from the client is converted 
to outgoing analog signal 444 by a modulator 446 in accordance with well-known techniques 
such as used in existing modems, and then applied to echo canceler 442 as well as fed onto 
local loop 122 via hybrid network 152. At the central office, this is converted to digital 
network connection 136 by line interface 140. Digital telephone network 134 transfers the 
data on digital network connection 136 to digital network connection 130. A demodulator 
440 then converts this to data stream 102 for the server. 

For systems using a reverse channel, such as is shown in Figure 17, the decoder 156 
may be coupled to a conventional modulator 446, such as a V.34 modulator, to provide 
bidirectional communication. In this case, an echo canceler 442 is preferably used to prevent 
the output of the modulator 446 from appearing as an input to the decoder 156. 

Although a conventional echo canceler may be used, the nature of the signals in the system 
described herein have special properties that may be advantageously used. Specifically, the incoming 
analog signal 154 may have frequency components from near DC up to 4 kHz, whereas the outgoing 
signal from the modulator 446 is more tightly bandlimitted to the range of 400 Hz to 3400 Hz. This 
asymmetry in bandwidths between the incoming and outgoing channels may be exploited by using an 
asymmetric echo canceler. Moreover, if the bandwidth of the outgoing channel is further reduced, the 
asymmetry will be even greater and the benefit of the asymmetric echo canceler will increase. 

At the encoder 150 end of the connection, a digital echo canceler is preferably used between 
the encoder 150 and the demodulator 440 shown in Figure 17. Here again, the asymmetric form of 
■ the connection may be exploited by using an asymmetric echo canceler. 

Operation 

The system shown in Figure 17 provides full duplex communication between two 
telephone subscribers: one with digital connectivity, and the other with analog connectivity. . 
The operation of the forward channel is as described above in reference to Figure 3, with one 
addition. Echo canceler 442, inserted between hybrid network 152 and decoder 156 has been 
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added to reduce the effects of the reverse channel. Echo canceler 442 scales outgoing analog 
signal 444 and subtracts it from a incoming analog signal 448 to produce analog signal 154. 
The techniques and implementation of echo cancelers are well known. The reverse channel 
can be implemented using a variant of existing modem technology. See, for example, 
5 International Telecommunication Union, Telecommunication Standardization Sector (ITU- 
T), "A Duplex Modem Operating at Signaling Rates of up to 14,400 Bit/sfor Use on the 
General Switched Telephone Network and on Leased Point to Point l-wire Telephone-Type 
Circuits " Recommendation V.32bis, Geneva, Switzerland (1991), incorporated herein by 
reference. Data are modulated by modulator 446 to form outgoing analog signal 444 that can 

1 0 be carried by the telephone system. The modulation techniques that may be employed are 
well known. For example, methods capable of transfers at up to 14,400 bits/second are 
described above. Similarly, methods capable of transfer rates up to 28,800 bits/second are 
described in International Telecommunication Union, Telecommunication Standardization 
Sector (ITU-T), Recommendation V.34 Geneva, Switzerland (1994), also incorporated herein 

1 5 by reference. 

Outgoing analog signal 444 is placed on local loop 122, using hybrid network 152, 
such as is employed in virtually all telephone equipment. Hybrid network 152 converts 
between a four-wire interface (two independent, unidirectional signals) on one side and a 

20 two-wire interface (one bidirectional signal) on the other side. The two-wire signal is simply 
the sum of the two signals on the four-wire side. At the client's central office, the telephone 
company's equipment converts the analog signal on local loop 122 to digital network 
connection 136, which is sampled at 8,000 samples/second using telephone system clock 236. 
In North America, this conversion is performed to provide eight bits per sample using a 

25 nonlinear mapping known as ^-law to improve the signal-to-noise ratio of typical audio 

signals. Once converted to |i-law, the clients signal is carried by digital telephone network 
134 until it reaches the server's premises. Note that since the server has a digital connection 
to the phone system, the signal is not converted to analog form by the server's central office. 
There may, however, be several layers of interfaces (such as ISDN 'U' or 'S', etc.) intervening 

30 between the server and digital network connection 136. However, since the same data 

presented at digital network connection 136 also appears at digital network connection 130 
later, this intervening hardware can be ignored. Demodulator 440 performs the inverse 
function of modulator 446, as done by existing modems, with one small exception. Since 
both its input and output are digital, it can be implemented completely in digital hardware, 

35 whereas existing modems must work with an analog input. As with modulator 446, the 
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implementation of demodulator 440 is well known and is described in the literature such as 
International Telecommunication Union, Telecommunication Standardization Sector (TTU- 
T), "A Duplex Modem Operating at Signaling Rates of up to J 4,400 bit/s for Use on the 
General Switched Telephone Network and on Leased Point-to-Poini 2-wire Telephone-type 
5 Circuits, " Recommendation V.32 bis, Geneva, Switzerland (1991). Note that even the 

reverse channel can exhibit performance superior to traditional modems since degradation of 
the signal will occur only at the consumer's local loop. Existing modems must deal with 
distortions occurring on local loops at both ends of the communications path. Alternative 
implementations of this invention may use other well-known methods or techniques to 

1 0 provide a reverse channel or may eliminate it altogether. Thus, the description of one 

possible reverse channel implementation is provided merely for illustration and should not be 
construed as limiting the scope of this aspect of the invention. Note that the provision of a 
reverse channel also simplifies the synchronization of decoder 156 and encoder 150 and 
allows the system to be re-initialized if needed. The performance of the system may be 

1 5 monitored by decoder 156 by examination of error signal 272 of Figure 10, If error signal 
272 exceeds a given level, preferably one-third of the average difference between |i-law 
linear values, decoder 156 can notify encoder 150 via the reverse channel that the system 
should be re-initialized, 

20 Combination with a Source Coder 

It is possible to extend the function of encoder 150 and decoder 156 shown in Figure 
3 to perform additional invertible transformations on data stream 100 before application to 
encoder 150. The effects of these transformations can be removed by applying the inverse 
transformation to the output of decoder 156 before producing data stream 126. This 

25 transformation advantageously may provide any invertible, function including, but not limited 
to: 

Error Correction 

Bits may be added to the data stream to provide error correction and/or detection 
30 using any of the well-known methods for such operations. These include, for example, 
convolutional coding, block codes or other error correction or detection schemes well 
docurriented in the literature. Note that if the same error processing applied to data stream 
126 is also inserted in the signal path from linear-to-fi-law converter 276 to |u-law -to-linear 
converter 278, shown in Figure 10, the quality of desired output signal 286, linear value 284, 
35 and error signal 272 will be improved and the performance of decoder 1 56 will benefit. 
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Subset of Source Alphabet: 

Altaugh there ^256 possible m-I.w codewords available for daa .ra„s„„ss,o„ 0,e 
Maw n,appi„g „s>,l,si„ U,ese w„ds being unequally spaeed in ,be bnear doma,n Tl,us' 

son,e pairs Of codewords wi,, be „„„ easily confused by deeoden56due,o„„e noise or 

o,her,.pa™. ™es„„ce coder can ,es«c,i.o„,p„„o.subse.ofO,ese codewords .0 
.mprovc U,e accuracy of decoder 156 a. ,h. expense of „d„ced gross da,a ra,e. TOs can also 
be u.d .0 adap. decoder ,o poor line condirions by reduc„g .c codeword aipbabTi I 
decoder detecu Ura, i. is ™ab,e .o separate codewords wi«„ a given e.or c.,er,on By 
r«luc.ng ,he codeword se, ,„pr„ved error margins will „suU a, ,Ke cos, of decreased dau 
rate. Thus, ,hc sysK„ can handle degraded connecions by lowering >he data „,e^ 

cod ''"r " "^"'"""'^ - ' PCM 

codewords used by the dtgttal telephone network ,3. In *e s^ples, intplccntatton. all 25. 

posstble PCM codewords can be used and the data can be sin,ply t..en 8 b,ts a, a .i„e and 1 
verbatim as the PCM words. 



PCM values, ,he„ are two codewords front the sc, of 256 .hat ntap onto the sante analog value ^ 
. would be .„po.ible to dtstinguish between these codewords using only the resulting Log sign ' 

™ch as he analog stgna, ,54. Second, the ,,aw ,„te,rcta.ion of the PCM codewords co„c^nl 
nc,ual y spaced analog levels. Uvels ..0. the companding ,.le tha, arc closely spaced arelily 

confused and should be avoided. the digital telephone networ. ,34 s„.c.™es uses the Z 

s.^„^.n, b,. Of the PCM codewords for intc™, si^ai.ng talcing these b,ts unrehablc. Poul 

ZT ~ '""^-'^ '° -'«^ --Be level, they are passed 

trough vanous ftltcrs. such as the CODECs sntoothtng nhcrand thesubscHber loop. rcsuhof 
h.s .s that s»,e frequency cotrtponen.s, notably DC and high..c,uencies, are attenuated. If^^ 
deco^^er ,56 .s to e,ual.e these frequenoy contponents, noise levels w,ll be necessarily increasl 
resulttng .„ .eater confusion between levels. Pi„, the d.gital telephone networ. 134 .ay pcrfortn a 
remapping of the codewords onto new values frnn, th , PC"orm a 

s^"^^ set such as would be the case on an 

mtemational call that uses both u-law nnH a lo, 

maw and A-law encoding, or if the network attempts to modify the 
Signal levels by remapping. ^ 



The system shown herein may deal with these 
only a subset of the 256 PGM codeword<: Tr, ^aa *- , " ' -"^^.^w i j^y 

words. In addition, the encoder 150 may choose the PCM 



issues in two ways. First, the encoder 150 may use 



wo 98/37657 



36 



PCT/US98/03093 



codewords with reference to previously transmitted codewords in order to reduce certain frequency 
components in the resulting analog signal 154. 

The first step in this process is to identify the frequency and noise characteristics of the 
transmission channel. The encoder 150 sends a known training pattern consisting of randomly chosen 
independent PCM codewords. When converted to an analog signal, such as the analog signal 154, 
this will result in an analog signal with an approximately flat frequency spectrum. The decoder 156 
receives a distorted version of the analog signal 154 and constructs a synchronizer and equalizer that 
reduces this distortion. In the process, the decoder 156 obtains measurements of the noise levels and 
filtering characteristics of the line. These measurements are transmitted back to the encoder 150. 
These steps are described above under the heading "Preferred Alternate Training Procedure." 

With the noise levels known, the encoder 150 may then choose a subset of the PCM codewords 
such that the probability of any one codeword being confused with another due to the noise is below 
some preset threshold probability. The subset is chosen by first calculating the required minimum 
separation between the codewords using the noise statistics. The codeword set is then chosen by 
selecting the largest possible set for which no pair of codewords is separated by less than the 
minimum preset threshold. The choice of codeword set may also be constrained to not use any 
codewords that will be corrupted by bitrobbing, as is further described below. 

To eliminate certain frequencies from the analog signals reconstructed from the PCM codewords, 
one technique is to insert additional codewords at regular intervals that do not contain data. These 
insertions are used to shape the output spectrum. For example, if we wish to eliminate DC, then once 
for each N data-carrying codewords, a codeword is inserted whose analog value is as close as possible 
to the negative of the sum of the values of all previous codewords, as described above with reference 
to the DC Eliminator 184. 

In general, the inserted codewords may be chosen to shape the spectrum as needed. For example, 
the codewords may be passed through a digital filter at the encoder 150, with the inserted codewords 
being selected to minimize the output energy of the filter. If the digital filter is chosen to pass 
components that it is desirable to eliminate, such as low frequencies or those near 4 kHz, then this 
procedure may minimize those components. 

Since the data-carrying codewords are chosen from a subset of the 256 possible codewords, the 
data usually cannot simply be placed in the codewords 8 bits at a time. Instead, a group of bits from 
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the data are used to choose a sequence of codewords. For example, if the subset consists of only 3 
codewords, then we could choose the value of groups of 4 codewords (of which there are 3' = 81 
possibilities) using groups of 6 input bits (of which there are 2' or 64 possibilities). In this case, there 
is some waste of the possible information content, but this decreases as the length of the groups are 

increased. 



Use With 56,000 bit/second Telephone Systems 

In some PCM transmission schemes used by the telephone systems, the least 
significant bit of each eight-bit codeword is used for internal synchronization. This can be 
handled by transforming data stream I 00 by inserting a zero bit once per eight bits such that 
the encoding process described in reference to Figure 5 will place the inserted bit into the 
least-significant bit position of each encoded value applied to digital network connection 132. 
These inserted zeroes will then be removed at decoder 156 by post-processing data stream 
126. In this way, the telephone system's use of the low order bit will not damage the 
transmitted data, but the maximum data rate will be reduced to 56,000 bits/second. 

On the long distance telephone transmissions, including transmissions over the digital telephone 
network 134, some traffic is carried on lines which use in-band signaling. In these cases, the digital 
telephone network 134 may use (or usurp) the least significant bit ("LSB") of every sixth PCM 
codeword for ring indication and other signals. This technique is commonly known as "Robbed-bit 
signaling" or simply "bitrobbing." If the telephone connection is used to cany data, then this implies 
that only 7 bits can be used during the bitrobbed fi-ames. Since the sender has no control over the 
bitrobbing, one approach to deal with this problem is to never use the LSB, thereby reducing the 
maximum data rate to 56 kbps (7 bits/codeword x 8000 codewords/second). 

The system shown in Figure 3, for example, may improve upon this by having the decoder 156 
identify the bitrobbed frames and then direct the encoder 150 to avoid the LSB only in the frames 
where bitrobbing is occurring. Thus, a single hop which uses bitrobbing will reduce the bit rate less; 
i.e to 62.7 kbps instead of 56 kbps. In the case of multiple hops over unsychronized links, bitrobbing 
may occur at a different phase resulting in fiirther reduction in bit rate. 

The detection of bitrobbed frames can be done during the initial training of the system. The 
encoder 150 sends a known pattern of 8-bit PCM codewords over the transmission channel and the 
decoder 156 stores samples from the resulting analog waveform it receives. The decoder 156 then 
attempts to resynchronize and equalize this signal to minimize the difference between its output and 
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the known pattern under the assumption that no bitrobbing occurred. The decoder 156 then measures 
the average equalized values at each of 6 phases. That is, the errors at the 1", 7'\ 13'\ 19'\ etc. 
samples are average as are the errors at the 2°', 8", 14", etc. samples giving 6 average error 
measurements. The decoder 156 then makes a decision for each phase as to v^rhether it has 1) not 
. been bitrobbed, 2) been bitrobbed, with the LSB replaced by 0, 3) been bitrobbed, with the LSB 
replaced by 1, or 4) been bitrobbed, with the LSB replaced by Vi. The choice is made by determining 
which bitrobbing scheme (1, 2," 3 or 4) minimizes the difference between the equalized signal and the 
known pattern after undergoing the given bitrobbing. 

0 Once the bitrobbing that occurred in each frame is determined, the equalization process is rerun, 

since the first equalization was done without knowledge of the bitrobbing. This second pass will 
provide a better equalized signal. The bitrobbing decision can then be verified with the second 
equalized signal in the same manner as above. 

5 Once the bitrobbing is known for each of the 6 phases, the decoder 1 56 preferably transmits this 

information to the encoder 150. In subsequent data transmissions the encoder 150 and decoder 156 
may avoid using bits that will be corrupted by bitrobbing. 

In an alternative approach, the encoder 150 sends a known pattern of codewords after 
20 the above described clock synchronization and equalization steps have been completed. The 
decoder 156 may then compute statistics regarding the received signal levels, such as the 
levels represented by the compensated signal 274 shown in Figure 10, for each of the 
transmitted 256 PCM codewords for each of the 6 phases. The computed statistics, including 
the mean signal level and the variance, may then be used to select a subset of codewords that 
25 provides a predetermined probability of error. The selected subset may then be transmitted to 
the encoder 1 50 and used in subsequent transmissions. In addition, the ^-law-to-linear and 
linear-to-n-law converters 192, 276 and 278 may then use the mean levels computed above 
instead of the predetermined levels of the converters 192, 276 and 278. This method, 
therefore, provides adaptive converters that may handle implicitly, and without prior 
30 knov^ledge or explicit analysis, bitrobbing or other remapping that occurs in the digital 
telephone network 134. 

Data Compression 

The source coder may provide lossless (or lossy) compression of the data stream 100 
35 using any of the various known techniques well known to those skilled in the art. These 
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include, but are not limited to, Lempcl-Ziv compression, nin-length coding, and Huffman 
encoding. The inversion of the chosen compression transformation, which is also well 
known, can be applied to data stream 126. 

5 Use with Other Telephone Systems 

The above methods can also be used with telephone systems that use nonlinear 
companding operations other than |i-law to transport the audio signal. For example, many 
parts of the world use a similar encoding, known as A-law. Aspects of the present inventions 
can be adapted to such systems by replacing all ^-law -to-linear and linear-to-|i-law 
10 converters with their A-law equivalents. These equivalents can also be implemented using a 
256-element lookup table. In this case the table would be populated with the well-known A- 
law mapping. These modifications will be evident to those skilled in the art. 

Combination with Existing Modems 

1 5 An aspect of the present invention may also be used in conjunction with existing 

modems. In a traditional system, such as shown in Figure 1, modem 104 may be modified to 
also incorporate the functionality of encoder 150 described above. Furthermore, modem 124 
may be modified to also include the functionality of decoder 156. When a call is connected 
between the modified modem 104 and modem 124, both operate as for a normal connection 

20 between unmodified modems. After they have completed their initiation, modem 104 can 
send a negotiation request to modem 124 using well-known negotiation protocols such as 
those standardized by the International Telecommunications Union. If modem 124 includes 
an implementation of decoder 156, it can respond positively to the request. Otherwise the 
request will be rejected and normal modem communications will be used. Once a positive 

25 response has been received, modem 124 and modem 104 can switch to operating as shown in 
Figure 17, beginning with an initialization sequence. In this way, a combined 
modem/decoder can interoperate with existing modems and, when possible, also 
advantageously provide increased throughput using an aspect of the present invention. 

30 Combination with a Database Server 

An aspect of the present invention may be used with a central server to provide data 
communications of any type (information, audio, video, etc.) between a central site and 
multiple users as shown in Figure 1 8. ''A server 450 provides a server data 452 to a server 
interface 454 which consists of an array of encoders, such as encoder 150 described herein, 

3 5 and, possibly, an array of demodulators such as demodulator 440. Server interface 454 
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connects to digital telephone network 134 via a server connection 456 such as an ISDN PRI 
interface. Each subscriber to the service has a client interface 460 consisting of decoder 156 
and, optionally, echo canceler 442 and modulator 446 similar to those shown in Figure 17. 
Client interface 460 operates on a client connection 458 to provide a client data stream 462. 
5 Overall, this configuration allows multiple users to independently communicate with a central 
server or servers. This configuration is usable for any type of data service including, but not 
limited to: audio or music distribution, on-line services, access to networking services, video 
or television distribution, voice, information distribution, credit-card validation, banking, 
interactive computer access, remote inventory management, point-of-sale terminals, 
1 0 multimedia. Other implementations or configurations of this invention are also applicable to 
these and other applications. 

High-Speed Facsimile Transmission 

An aspect of the present invention, shown in Figure 19, may be used for high-speed 
1 5 transmission of facsimiles. A transmitting FAX 470 scans an image and translates it into a 
transmitted data stream 472 in a well-known mariner. Transmitted data stream 472 is 
transmitted to a received data stream 476 via a distribution system 474 as shown, for 
example, in Figure 17. A receiving fax 478 converts the data stream back into an image and 
prints or otherwise displays it. Distribution system 474 may l?e implemented as shown in 
20 Figure 17 with data stream 100 replaced by transmitted data stream 472 and data stream 126 
replaced by received data stream 476. Furthermore, data stream 128 and data stream 126 may 
be used for protocol negotiations between receiving fax 478 and transmitting FAX 470 as 
described in International Telecommunication Union, Telecommunication Standardization 
Sector (ITU-T), Recommendation V.17, *'A 2-Wire Modem for Facsimile Applications With 
25 Rates up to 14,400 b/s, " Geneva, Switzerland (1991 ) which is hereby incorporated herein by 
reference. In this way, facsimiles from transmitting FAX 470 can be advantageously 
transmitted to receiving fax 478 at rates higher than possible using conventional transmission 
schemes. 

30 ISDN/Digital Telephony Relay 

An aspect of the present invention can also be used in conjunction with any 
application that can make use of ISDN of digital telephony. This can provide a functional 
equivalent to ISDN for transmission from a digitally connected party to a second party who 
has only analog connectivity to the telephone network. This could be done either directly 
35 using a system such as shown in Figure 17, or by use of a mediating relay as shown in Figure 



wo 98/37657 



41 



PCT/US9S/03093 



20.;- A digital subscriber 480 can make a digital call to an analog subscriber 490, who does 
not have direct digital access to the digital telephone network but has instead an analog 
subscriber connection 488. A fully digital connection is opened between digital subscriber 
480 and a relay server 484 using a digital connection 482 such as ISDN, Switched-56, Tl, or 
the like. Relay server 484 then communicates along a relay connection 486 with analog 
subscriber 490 using any means available such as a traditional modem or a system such as 
was shown in Figure 17. With appropriate flow-control methods, which are well known to 
those skilled in the art, it will appear to the digital subscriber that a digital connection has 
been opened to the analog-only subscriber. Such a connection can be used for any digital 
communication, such as voice, data, digital FAX, video, audio, etc. Note that it is also 
possible to incorporate relay server 484 into the actual digital telephone network 134 to 
provide apparent digital connectivity to analog subscribers transparently. 
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SCOPE 

While the invention has been described in connection with, what is presently 
considered to be, the most practical and preferred embodiments, it is to be understood that the 

5 invention is not limited to the disclosed embodiments, but on the contrary, it is intended to 
cover various modifications and equivalent arrangements included within the spirit and scope 
of the appended claims. For example, an equivalent training request can be accomplished by 
using the reverse channel in Figure 17. The reverse channel of Figure 17 also can provide 
other equivalent configurations for the control of information flow from decoder 156 to the 

1 0 encoder 150. However, in such a configuration, the present invention still provides the 
transfer of data between the data provider and consumer. In addition, compensation of a 
telephone line may be accomplished by other equivalent configurations, which are well 
known to those skilled in the art; equivalent training procedures may be used, different 
equalization methods may be utilized, and the system may be adapted to other central office 

1 5 equipment without departing from the scope of the invention. TTierefore, persons of ordinary 
skill in this field are to understand that all such equivalent arrangements and modifications 
are to be included within the scope of the following claims. 
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APPENDIX-Example Pseudo-code Implementations 

The following pseudo-code segments are provided to aid in understanding the various parts of 
the present invention. They should not be construed as complete or optimal implementations. Note 
5 ' that these codes illustrate the operation of the basic system described above, without any of the 
additional enhancements discussed. Although given as software code, the actual implementations 
may be as stored-program(s) used by a processor, as dedicated hardware, or as a combination of the 
two. 
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Example Impietnentation of decoder 156 

/* Output begin training sync partem */ 
for (i=0;i<syncPhaseLength;i++) 

Output maximum code value 
for (i=0;i<syncPhaseLength;i++) 

Output minimum code value 

/• Output training data */ 
for (i=0;i<trainRcpeat;i-H-) 

for (j==Oj<trainLengih 

Output training pancm element j 

/* Output end training sync pattern */ 
for (i=0;i<syncPhaseLength;i++) 

Output minimum code value 
for (i=0;i<syncPhaseLength;i+H-) 

Output maximum code value 

sum=0 
loop forever 

Read an input data byte 

Output data byte 

Conven byte to equivalent linear value, x 
sum x; 

if (current output sample number is a multiple of dcPcriod) 
if (sum > 1.0) 

recover = maximum code value 
else if (sum < -1.0) 

recover = minimum code value 

else 

recover = code value having linear value closest to -sum 



Output recover 

sum -= linear equivalent of recover 
Example ImplemcnUtion of dock synchronizer 260 
Initialize filters array to be the impulse response of a low-pass 
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61ter with digital cutoff frequency PI/Nu. 

Initialize IpfBufiFer array to all zeroes. 

snum = -lpfLen/2; 
IpfPos = 0; 

Loop forever 

Read an input sample into val 

/* Store value in circular buflFer. lpfBuflFer[] •/ 

lpfBuflfer[lpfPos] = val; 

IpfPos = (lpfPos+l)%lp£Len; 

snum-H-; 

while (snum >= period) 

/• Extraa an output from resampler at 'period' units after 

the previous extraaed sample •/ 
snimi = snum - period; 
phase = (intXsnum*Nu); 
fi^c = snum*Nu-phasc; 

/* Compute output from two adjacent phases of filter */ 

IpfOutl =lpfDut2 = 0; 
for (i=0,p=lpfPos;i<lpfLen;i++,p=(p+l )%lpfLcn) 

IpfDutl lpfBuflfcrfp]»atcrs[i*Nu-t-phasc]; 

lpfOut2 += lpfBufifer[p]*filtcr5[i*Nu+phase+l]; 
/• Interpolate */ 

result = IpfDutl •(l-frac>+lpfDut2*frac; 

Write result as an output sample 

Eumple ImplementatioQ of decoder 156 

Loop forever 

Read a sample from clock synchronizer into 'samp' 
/* Put samp at the end of *inBuffer' •/ 
inBuffer[inPos] = samp; 
inPos = (inPos+l)%inBufLen; 

/* Check if we are just finishing a sync pattern */ 

if (last syncLength samples read are all negative and previous 
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svncLength samples are aU positive) 
if s-ples 31, posUiv, and previous 

syncLength samples are aU negative) 
inTraining = 0; 

/• Add sample to FFE buffer •/ 
ffeBufiFer[ffePos] = samp; 
efePos = (ffePos+D'/offeLen; 

/. Only need to compute output every second sample '/ 
if(fFePosVo2 = 0) . 

ffS^fU DotProd(&ffeBuffer[0].&ffeWts[ffeLen- 
£FePos],ffePos); 

/• Subtrart FBE output •/ 
ffeOut -= fbeOut; 

/• Convert output to nearest code V 
codeOut = Linear2Code(flfeOut); 

^^"'""^rStrainingpatterntocala.lateerror^^ 
eEst = ffeOut - Code2Linear(tram[tposl) 
tpos = (tpos+l)''/otrainLength; 

""^^ r Calculate decision feedback error •/ 
eEst = fFeOut-Code2Lincar(codeOut); 

/• Updaie equalizers •/ 

^'^gwiE;?- ffeGainVEst-ffeBuff^^^^^ 

^•'^^^Ti^LGain-eEst-fbeBuffertCfbePos.p^^^ 
/. Calculate derivative of output with respea to tune 
out[0] = out[ll; 

out[ll = °^^^^\' 
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out[2] = SeOui; 

deriv = (out[2]-out[0])/2; 

/• Calculate phase error */ 
num •= pUPole; 
denom *= pllPole; 
num prevEEst*deriv; 
denom += deriv* deriv; 
pdAdjust = num/denom; 

/• Update resampler period (fed to clock synchronizer) */ 
period = midPeriod-»T5UGain'pdAdjust; 

/* Save error estimate for next cycle •/ 
prevEEst = eEst; 

/• Compute next FBE output */ 
fbeBu£fer[fbePos] = ffeOut; . 
fbePos = (fbePos+l)%fbeLcn; 

fbeOut ^ DotProd(&fbeBuflFer[ft>ePos].&fbeWts[0],fbcLcn- fbePos); 
fbeOut += DotProd(&fbdBuffer(0],&fbeWts[fbeLcn- fbePosJ.fbcPos); 

/* Output a sample (delayed) if we are active */ 
if (outputting) 

if (oSampNum>0 && (oSampNum%dcPcriod) != 0) 
Output outBuflFcr[outBufPos] 

oSampNum-^-+•; 

/• Store new sample in output buflfcr •/ 
outBufifcrtoutBufPos] = codeOut; 
outBufPos = (ouiBufPos+l)%outBufLen; 

/• Check if sync in buffer and set outputting accordingly */ if 
(last syncLcngth/2 samples placed in outBuffer are negative 

and previous syncLcngth/2 samples are positive) 
outputting = 0; 
else if (last syncLength/2 samples placed in outBuffer are 

negative and prev, syncLength/2 samples are positive) 
outputting = 1; 

oSampNum =f -syncLcngth + 1 ; 
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WHAT IS CLAIMED IS: 

1 . In a communication system that includes an encoder and a decoder, wherein the 
encoder has a digital connection to a digital portion of a telephone network and the digital portion of 
the telephone network is connected by an analog loop to the decoder, a training method comprises the 
steps of: 

transmitting M repetitions of N codewords from the encoder to the decoder, where M and N 
are integers that are known to the decoder and said codewords correspond to PCM codes utilized by 
the digital portion of the telephone network; 

the decoder; sampling a received sequence of analog voltage levels corresponding to said 

transmitted codewords; 

storing a value associated with each sample; 
analyzing the stored values; and 

adjusting a parameter of the decoder in accordance with the analysis. 

2. A training method as claimed in claim 1 , wherein the N codewords are randomly 
selected from a subset of two PCM codewords, and wherein the subset of two PCM codewords are 
negatives of each other under a.p-law companing rule implemented by the telephone network. 



20 3. Attaining 

selected N/2 times.. 



25 



method as claimed in claim 2, wherein each of said two PCM codewords is 



4. A training method as claimed in claim 1, wherein said received sequence is sampled 
at twice the clock rate of the digital portion of the telephone network. 

5 A training method as claimed in claim 1 , wherein said received sequence is sampled 
at a rate of 16,000 samples/second. 

6 A training method as claimed in claim 1 , wherein said steps of analyzing the stored 
30 values comprises the step of determining a rate at which the M repetitions occur. 

7 A training method as claimed in claim 6, wherein said steps of analyzing further 
comprises the steps of determining a sample period associated with the rate at which the M repetition 
occurs; comparing the determined period to N/8000 seconds; and adjusting a sampling rate clock m 

35 the decoder in accordance with the comparison. 
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8. A training method as claimed in claim 7, further comprising the step of resampling 
the stored values using the adjusted sampling rate clock. 

9. A training method as claimed in claim 8, further comprising the steps of repeating the 
steps of claim 7 on the resampled values. 

10. A training method as claimed in claim 1, wherein the steps of analyzing the stored 
values comprises the step of measuring the variance of the M repetitions to thereby measure a noise 
estimate. 

11. A training method as claimed in claim 1, wherein the step of analyzing the stored 
values comprises the step of calculating an average received signal level from the M repetitions. 

1 2. A training method as claimed in claim 1 , wherein said parameter is associated with an 
equalizer in said decoder. 

13. A training method as claimed in claim 12, wherein said parameter is adjusted in 
accordance with at least one of a predetermined sequence stored at the decoder, a measure of average 
received signal level, and a noise estimate. 

14. A training method as claimed in claim 12, wherein said step of analyzing comprises 
calculating a mean-squared error estimate. 

15. A training method as claimed in claim 14, wherein said parameter is adjusted to 
achieve an equalizer having a minimum mean-squared error. 

16. A training method as claimed in claim 15, further comprising the step of transmitting 
said parameter back to said encoder. 

17. A training method as claimed in claim 16, further comprising the step of, at said 
encoder, choosing a codeword set for data transmission based upon said parameter. 

18. A training method as claimed in claim 1 , further comprising the step of updating said 
training based upon a measure of deviation between a compensated signal and a nearest codeword. 
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19. A training method as claimed in claim 18, further comprising the step of continuously 
updating a sampling rate clock and a parameter associated with an equalizer in accordance with said 
measure of deviation. - 

5 

20. A training method as claimed in claim 19, further comprising the step of retraining 
when said measure of deviation exceeds a predetermined threshold, 

21. In a communication system that includes an encoder and a decoder, wherein the 

1 0 encoder has a digital connection to a digital portion of a telephone network and the digital portion of 
the telephone network is connected by an analog loop to the decoder, wherein the analog loop 
converts digital information fi-om the network into analog voltages for transmission to the decoder, a 
method of detecting the presence of robbed-bit signaling within the digital portion of the telephone 
network comprising the steps of: 

1 5 sending a predetermined pattern of PCM codewords from the encoder to the digital portion of 

the telephone network; 

receiving said predetermined pattern of PCM codewords in the form of analog voltages at the 
decoder; 

determining an error measurement at the decoder in response to said received analog 
20 voltages; and 

determining whether robbed-bit signaling is present based upon said error measurements. 



22. A method of detecting the presence of robbed-bit signaling as in claim 21 wherein the 
25 error measurement determining step includes comparing said received analog voltages to 

predetermined reference voltages. 

23. A method of detecting the presence of robbed-bit signaling as in claim 21 wherein 
said predetermined pattern is partitioned into M frames, each of said M frames having N time slots. 

30 . 

24. A method of detecting the presence of robbed-bit signaling as in claim 23 wherein 
said error measurement step comprises forming N average error measurements corresponding to said 
N time slots. 
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25. A method of detecting the presence of robbed-bit signaling as in claim 24 wherein 
each of said N average error measurements is formed by averaging every Nth error measurement. 

26. A method of detecting the presence of robbed-bit signaling as in claim 23 where N=6. 

5 

27. A method of detecting the presence of robbed-bit signaling as in claim 21 wherein 
said robbed-bit signaling determining step further comprises the steps of: 

determining if the magnitudes of said error measurements are cyclically repetitive; and 
when said error measurements are cyclically repetitive, determining whether said cyclically 
1 0 repetitive error measurements result from robbed-bit signaling- 

28. In a communication system that includes an encoder and a decoder, wherein the 
encoder has a digital connection to a digital portion of a telephone network and the digital portion of 
the telephone network is connected by an analog loop to the decoder, a method of selecting a PCM 

1 5 codeword set comprising the steps of: 

transmitting a sequence of PCM codewords from the encoder; 
receiving said sequence as a sequence of analog voltages at the decoder; 
determining a noise level at the decoder in response to said received sequence of analog voltages; 
selecting a minimum separation value in response to said noise level determination; and 
20 selecting a set of PCM codewords such that no two PCM codewords within said set are separated by 
less than said selected minimum separation value. 



29. A method of selecting a PCM codeword set of claim 28 wherein said set selecting 
step further comprises the step of selecting a second a set of PCM codewords, wherein PCM 

25 codewords from said second set are used during bit-robbed time slots. 

30. A method of selecting a PCM codeword set of claim 28 wherein said encoding step is 
performed by a convolutional encoder, 

30 31. A method of selecting a PCM codeword set of claim 28 wherein said encoding step is 

performed by a block encoder. 

32. A method of selecting a PCM codeword set of claim 28 wherein said encoding step is 
performed by a trellis encoder. 
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33. A method of selecting a PCM codeword set of claim 28 wherein said noise level 
determining step further comprises the step of measuring the variance of the received sequence of 
analog voltages. 

34. In a communication system that includes an encoder and a decoder, wherein the 
encoder has a digital connection to a digital portion of a telephone network and the digital portion of 
the telephone network is connected by an analog loop to the decoder, a method of conveying 
information from the encoder to the decoder comprising the steps of: 

transmitting a sequence of PCM codewords from the encoder; 
receiving said sequence as a sequence of analog voltages at the decoder; 
determining a noise level at the decoder in response to said received sequence of analog 
voltages; 

selecting a minimum separation value in response to said noise level determination; 

selecting a set of PCM codewords such that no two PCM codewords within said set are 
separated by less than said selected minimum separation value; and 

encoding a sequence of information bits to a sequence of PCM codewords firom said selected 
codeword set to convey information from said encoder to said decoder. 

35. A method of conveying information of .claim 34 wherein said set selecting step 
further comprises the step of selecting a second a set of PCM codewords, wherein PCM codewords 
from said second set are used during bit-robbed time slots, 

36. A method of conveying information, of claim 34 wherein said encoding step is 
performed by a convolutional encoder. 

37. A method of conveying information of claim 34 wherein said encoding step is 
performed by a block encoder. 

38. A method of conveying information of claim 34 wherein said encoding step is 
performed by a trellis encoder. 

39. A method of conveying information of claim 34 wherein said noise level determining 
step further comprises the step of measuring the variance of the received sequence of analog voltages- 
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FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to the PCX on the front pages of pamphlets publishing international applications under the PCX. 



AL 


Albania 


ES 


Spain 


LS 


AM 


Armenia 


FI 


Finland 


LT 


AT 


Austria 


FR 


France 


LU 


AU 


Australia 


GA 


Gabon 


LV 


AZ 


Azerbaijan 


GB 


United Kingdom 


MC 


BA 


Bosnia and Herzegovina 


CE 


Georgia 


MD 


BB 


Barbados 


GH 


Ghana 


MG 


BE 


Belgium 


GN 


Guinea 


MK 


BF 


Burkina Faso 


GR 


Greece 




BG . 


Bulgaria 


HU 


Hungary 


ML 


BJ 


Benin 


IE 


Ireland 


MN 


BR 


Brazil 


IL 


Israel 


MR 


BY 


Befarus 


IS 


Iceland 


MW 


CA 


Canada 


IT 


Italy 


MX 


CF 


Central African Republic 


JP 


Japan 


NE 


CG 


Congo 


KE 


Kenya 


NL 


CH 


Swi(zcrlaiid 


KG 


Kyrgyzsian , 


NO 


CI 


C6te d'lvoirc 


KP 


Democratic Peoplc*s 


N2 


CM 


Cameroon 




Republic of Korea 


PL 


CN 


China 


KR 


Republic of Korea 


PT 


CU 


Cuba 


KZ 


Kazakstan 


RO 


cz 


Czech Republic 


LC 


Saint Lucia 


RU 


DE 


Germany 


LI 


Liechtenstein 


50 


DK 


Denmark 


. LK 


Sri Lanka 


SE 


KK 


Estonia 


LR 


Liberia 


SG 



Lesotho 

Lithuania 

Luxembourg 

Latvia 

Monaco 

Republic of Moldova 

Madagascar 

The former Yugoslav 

Republic of Macedonia 

Mali 

Mongolia 

Mauritania 

Malawi 

Mexico 

Niger 

Netherlands 

Norway 

New Zealand 

Poland 

Portugal 

Romania 

Russian Federation 

Sudan 

Sweden 

Singapore 



SI 


Slovenia 


SK 


Slovakia 


SN 


Senegal 


SZ 


Swaziland 


TD 


Chad 


TG 


Togo 


TJ 


Tajikistan 


TM 


Turkmenistan 


TR 


Turkey 


TT 


Trinidad and Tobago 


UA 


Ukraine 


UG 


Uganda 


US 


United States of America 


uz 


Uzbekistan 


VN 


Viet Nam 


YU 


Yugoslavia 


ZW 


Zimbabwe 



